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ABSTRACT 



We determine the first fossil group luminosity function based on spectroscopy of the member 
galaxies. The fossil group RX J1552. 2+2013 has 36 confirmed members, it is at a mean redshift 
O \ of 0.136 and has a velocity dispersion of 623 km s^^ (or 797 km s^^ if four emission lines 

■4^ ■ galaxies in the outskirts of the velocity distribution are included). The luminosity function of 

^ \ RX J1552. 2+2013, measured within the inner region of the system l/ZRyir), in the range -23.5 

< Mi/ < -17.5, is well fitted by a Schechter function with M*, = -21.3 ± 0.4 and a = -0.6 ± 0.3 
or a Gaussian function centered on M;/ = —20.0 ± 0.4 and with a = 1.29 ± 0.24 i' mag (Hg = 
■ 70 km s~^ Mpc~^, r2M=0.3, riA=0.7). The luminosity function obtained from a photometric 

\ survey in g', r', i'-bands (and statistical background correction) confirms the spectroscopically 

determined results. There is a significant dip in the luminosity function at Mr'=-18 mag, as also 
observed for other clusters. RX J1552. 2+2013 is a rich, strongly red-galaxy dominated system, 
with at least 19 galaxies with magnitudes between ma and ma + 2, within a surveyed circular 
area of radius 625 h^g^ kpc centered on the peak of the x-ray emission. Its mass, ~ 3 x 10^^ M©, 
M/L of 507 Mq/Lbq and of 6.3 x 10**^ h^Q^ ergs s~^ (bolometric) are more representative 
of a fossil cluster than of a fossil group. The central object of RX J1552. 2+2013 is a cD galaxy 
which may have accreted the more luminous {'^ L*) former members of the group. Although 
dynamical friction and subsequent merging are probably the processes responsible for the lack 
of bright galaxies in the system, for the fainter members, there must be another mechanism in 
action (perhaps tidal disruption) to deplete the fossil group from intermediate-luminosity galaxies 
(M^/ - -18). 

Subject headings: cosmology: observations - galaxies: clusters: individual: RX J1552. 2+2013 - galaxies: 
elliptical and lenticular, cD - galaxies: evolution - galaxies: luminosity function, mass function - galaxies: 
kinematics and dynamics 



1 



1. Introduction 

A fossil group is a system with a large ex- 
tended X-ray halo, dominated by one brighter- 
than-L* elliptical galaxy which is surrounded by 
low-luminosity companions (where the difference 
in magnitude between the bright dominant ellipti- 
cal and the next brightest companion is > 2 mag) . 
The first system identified as a fossil group was 
RXJ1340.6-h4018, at a redshift of 0.171 (Ponman 
et al. 1994). A few years later, Vikhlinin et al. 
(1999) catalogued four systems which they called 
"X-ray overluminous elliptical galaxies" , given the 
unusually extended X-ray halos observed for what 
seemed to be isolated objects. These had es- 
sentially the same properties as fossil groups (in 
fact one of the four systems was the prototype 
fossil group from Ponman ct al. 1994). Subse- 
quently, Jones et al. (2003) catalogued five other 
fossil groups, selected from the WARPS survey. 
More recently, Yoshioka c;t al. (2004) catalogued 
four nearby systems (of which one is not a fos- 
sil group, namely RX J0419. 6-1-0225 is the rich 
group NGC 1550). A few other individual fos- 
sil groups were recently catalogued: Khosroshahi 
et al (2004), Sun et al. (2004) and Ulmer et al. 
(2005) presented detailed X-ray studies of three 
additional fossil groups, NGC 6482, ESQ 3060170 
and CI 1205-1-44, respectively. In total, there are 
then 15 known fossil groups catalogued to date 
(see Table 4). The X-ray halo of a fossil group is 
comparable in luminosity and extension to that of 
a rich group or poor cluster, suggesting that their 
masses may also be similar. Such systems are also 
thought to be quite abundant (their density is ~ 
2.4 X 10"'^ Mpc"^, Jones et al. 2003) and there- 
fore they may yield an important contribution to 
the luminosity density and to the baryon budget 
of the universe. 

The main scenario for the formation of fossil 
groups is that they are possibly the successors of 

'^Based on observations obtained at the Gemini Obser- 
vatory, which is operated by the Association of Universities 
for Research in Astronomy, Inc., under a cooperative agree- 
ment with the NSF on behalf of the Gemini partnership: 
the National Science Foundation (United States) , the Parti- 
cle Physics and Astronomy Research Council (United King- 
dom), the National Research Council (Canada), CONI- 
CYT (Chile), the Australian Research Council (Australia), 
CNPq (Brazil) and CONICET (Argentina) - Observing run 
ID: GN-2004B-Q-47. 



massive versions of today's compact groups {merg- 
ing origin, Jones et al. 2003). In such a scenario, 
the brightest galaxies of the system would have 
merged, leaving behind a group/cluster dominated 
by a single elliptical galaxy, surrounded by small 
companions. On the other hand, a recent X-ray 
study by Yoshioka ct al. (2004) points out that the 
M/L of four fossil groups studied by them reach up 
to M200/LB = 1100 M0/L0, being at least one or- 
der of magnitude higher than the typical M/L for 
groups/clusters of galaxies of similar mass, which 
makes it very unlikely that fossil groups could be 
descendants of groups/clusters. However, other 
recent works derive much lower values of M/L for 
other such systems (e.g. Sun et al. 2004) and 
therefore this matter is not yet settled. In addi- 
tion, it is possible that there is more than one for- 
mation mechanism for fossil groups. In the forma- 
tion scenario proposed by Yoshioka ct al. (2004), 
fossil groups are the massive end of the elliptical 
galaxy distribution, formed at high redshift {fossil- 
elliptical origin). 

In a recent paper, D'Onghia & Lake (2004), 
based on the luminosity function of one such 
group, pointed out that fossil groups may pose 
a severe problem for the cold dark matter mod- 
els. They pointed out that these systems do not 
have as much substructure as expected for such a 
massive system, and moreover the "missing galax- 
ies" are much more luminous than those lacking 
in poor groups and in the field. However, the lu- 
minosity function of one fossil group in which that 
conclusion is based has been determined through 
imaging of the group and statistical background 
subtraction (Jones et al. 2000), with very few 
known redshifts. In fact, most of the past studies 
about fossil groups focused on their X-ray prop- 
erties and very little information on their optical 
properties is available. In this paper, we present 
the first secure luminosity function determination 
of a fossil group, using spectroscopic data obtained 
with CMOS (Hook et al. 2002) on the Frederick C. 
Gillett Telescope (Gemini North) at Manna Kea. 

We present a spectroscopic study of RX J1552.2 
4-2013, one of the groups originally catalogued by 
Jones et al. (2003), selected from an X-ray survey 
done with ROSAT (WARPS) with well defined se- 
lection criteria. This system has high bolometric 
X-ray-luminosity (6.3 x 10^'^ h^g^ ergs"-^, Jones 
et al. 2003) and, before this study, it had one 
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of the largest number of known members (four). 
We determine the luminosity function of the group 
from g', r', i' photometry down to i'=23 and spec- 
troscopy of 36 members. Sections 2 and 3 describe 
the observations, the reduction procedure and the 
results. In Section 3 we include, in Table 4, a sum- 
mary of the main properties of the 15 known fossil 
groups to date. In section 4 we discuss the impli- 
cations of our results for the understanding of the 
nature and evolution of fossil groups. 

When needed, we adopt the following values 
for the cosmological parameters: Hq = 70 km s~^ 
Mpc-\ Qm=0.3, and Qa=0.7. 

2. Observations and reductions 

The imaging and multi-slit spectroscopic obser- 
vations of the group RX J1552. 2-1-2013 were done 
with the GMOS instrument, mounted on the Gem- 
ini North telescope, on Aug 8th and Sep 9th/2004 
respectively. 

The imaging consisted of 3 x 200s exposures 
in each of the three filters from the SDSS system 
(Fukugita et al. 1996) g', r' and i'. The typical 
FWHM for point sources was ^ 0.75" in all im- 
ages. All observations were performed in photo- 
metric conditions. Fig. 1 displays the r' image of 
the system. 

The calibration to the standard SDSS system 
was made with the general extinction coefficients 
provided by the Gemini observatory ^. The accu- 
racy of the calibration is claimed to be within 5% 
to 8%. 

Standard reduction using the Gemini package 
GMOS was used. After flat fielding and cleaning 
the images for cosmic rays, the final frames were 
analyzed with the program SExtractor (Bertin & 
Arnouts 1996). Positions and magnitudes (isopho- 
tal and aperture) were obtained for all objects. We 
estimate that the galaxy catalog is essentially com- 
plete down to 23.5 i' magnitude, since the number 
counts turn over at i'=24 mag. 

Candidates for spectroscopy were chosen based 
on the color- magnitude diagram shown in Fig. 2: 
most of the galaxies with Mj < -20, below the red 
sequence (see continuous line in the figure) were 
observed spectroscopically. Galaxies above this 
line are expected to be in the background, since 

'www.gemini . edu/sciops/instruments/gmos/gmosPhotStanc 




Fig. 1.— Optical image of RXJ1552.2-F2013. The 
field of view is 5.6 arcmin on a side, or 803 h^Q 
kpc at the object redshift. North is up and east is 
to the left. The circle indicates the isophote where 
the surface brightness of the galaxy is equal to one 
sigma of the sky 

their colors are redder than the expected colors 
of elliptical galaxies at the group redshift. Note 
that the outermost observed galaxy which turned 
out to be a member of the group/cluster has a 
distance of 625 h^^ kpc from the X-ray center of 
RX J1552.2-I-2013. 

One single multi-slit exposure of 100 minutes 
was obtained through a mask with 1.0" slits, using 
the R400 grating, for a final resolution of 8 A (as 
measured from the FWHM of the arc lines), cov- 
ering aproximatelly the range 4000 - 8000 A (de- 
pending on the position of each slitlet) . The spec- 
tra of thre(^ selected galaxies (from the best to the 
worst signal to noise) are shown in Fig. 3. Only 
four emission-line galaxies turned out to be mem- 
bers of the fossil-group. Most of them lie in the 
outskirts of the galaxy velocity distribution (see 
Table 1). 

Standard procedures were used to reduce the 
multi-slit spectra using tasks within the Gemini 
IRAF ^ package. Wavelength calibration was 

^IRAF is distributed by the National Optical Astronomy 
. htmObservatories, which are operated by the Association of 
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done using Cu-Ar comparison-lamp exposures be- 
fore and after the exposure. 

Redshifts for galaxies with absorption lines 
were determined using the cross-correlation tech- 
nique (Tonry & Davis 1979) as implemented in 
the package RVSAO (Kurtz & Mink 1998) run- 
ning under IRAF. The final heliocentric velocities 
of the galaxies were obtained by cross-correlation 
with several template spectra. The final errors on 
the velocities were determined from the disper- 
sion in the velocity estimates using several differ- 
ent galaxy and star templates. In the case of the 
three emission-line redshifts, the error was esti- 
mated from the dispersion in redshifts obtained 
using different emission lines. The resulting he- 
liocentric velocities typically have estimated rms 
errors between 25 and 100 km s^^. The S/N of the 
data, measured at the continuum region around 
6000-6300A, ranged from 10 to 30. 

Table 1 lists positions, isophotal magnitudes, 
aperture (g' - i') colors, radial velocities and the 
Tonry & Davis cross-correlation coefficient R for 
all galaxies with reliable velocity determination 
obtained in this study. 




14 16 18 20 22 



Fig. 2. — Color-magnitude diagram of the galaxies 
in the RX J1552.2-)-2013 field. Points marked with 
squares (members), 'Y' (non- members) and '-' 
(with spectra but no redshift) represent the galax- 
ies observed spectroscopically by us with GMOS- 
N. The circles (members), 'x' (non- members) and 
stars (doubtful cases) represent galaxies observed 
by Jones (2004, priv. comm.). The line indi- 
cates an upper limit for the cluster red-sequence 
we adopted when selecting the spectroscopic tar- 
gets. 



Universities for Research in Astronomy, Inc., under coop- 
erative agreement with the National Science Foundation. 
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Table 1 

Spectral data for galaxies in the RX J1552. 2+2013 field. 



(1) 




(2) 




(3) 




(4) 


[' 


V 


(6) 




(7) 




Name 


RA (2000) 


DEC (2000) 


■ / / A T~> TV T \ 

1 (AB Mag.) 


/ 

g 


-1 


Vel. (km s 




R 




004 5+1221"* 


15 


52 


04, 


.5 


+20 


12 


21 


19.38 


1 


.21 


26819 ± 


32 




b 


Glfi 4+lfi05 


15 


52 


16, 


.4 


+20 


16 


05 


16.47 


1 


.04 


26820 ± 


18 




b 


G12 2+1439 


15 


52 


12, 


.2 


+20 


14 


39 


18.49 


1 


.37 


38715 ± 


25 


6.3 




C23 2+1452 


15 


52 


23 


.2 


+20 


14 


52 


20.05 





.51 


39290 ± 


36 




b 


GIO 0+1342 


15 


52 


10, 


.0 


+20 


13 


42 


20.61 


1 


.17 


39374 ± 100 




b 


01 2 2+1 534 


15 


52 


12, 


.2 


+20 


15 


34 


18.18 


1 


.39 


39538 ± 


43 


7.3 






15 


52 


06 


,4 


+20 


14 


06 


19.71 


1 


.18 


39765 ± 100 


3.2 




Onfi 8+1312 


15 


52 


06, 


.8 


+20 


13 


12 


17.07 


1 


.50 


40103 ± 


34 


10.2 




OOQ 4+1 1 57 


15 


52 


09, 


.4 


+20 


11 


57 


IS 72 


I 


3fi 


40115 + 


46 


fi 4 




ni q+i 294 


15 


52 


10, 


.9 


+20 


12 


24 


21 80 


I 


03 


40206 ± 


59 


9 8 




012 q+1305 


15 


52 


12, 


.9 


+20 


13 


05 


19.33 


1 


.36 


40211 + 


48 


5.2 




Glfi 0+1 OOQ 


15 


52 


16, 


.0 


+20 


10 


09 


17.10 


1 


.44 


40227 + 


45 


5.9 




c;i5 q+121 1 

V. 1 x(^»f_y 1 x^xx 


15 


52 


15, 


.9 


+20 


12 


11 


19.10 


1 


.34 


40305 ± 


44 


5.6 




Gll.9+1234 


15 


52 


11, 


.9 


+20 


12 


34 


19.10 


1 


.38 


40344 ± 


39 


5.8 




G08.7+1136 


15 


52 


08, 


.7 


+20 


11 


36 


18.24 


1 


.44 


40472 ± 


56 


6.7 




G05 q+1246 


15 


52 


05, 


.9 


+20 


12 


46 


19.18 


1 


.22 


40704 ± 


47 


3.2 ' 




VJ X (_/ . t7 1 X WtJ 


15 


52 


15, 


.9 


+20 


10 


39 


17.68 


1 


.43 


40748 ± 


39 


6.5 




017 n+140fi 


15 


52 


17, 


.0 


+20 


14 


06 


20.00 


1 


.32 


40853 ± 


66 


4.1 




G18 fi+1410 


15 


52 


18, 


.6 


+20 


14 


10 


19.64 


1 


.32 


41001 + 


98 


4.1 




G16.8+1208 


15 


52 


16, 


.8 


+20 


12 


08 


19.97 


1 


.30 


41126 + 


87 


3.3 




G14.9+1404 


15 


52 


14, 


.9 


+20 


14 


04 


18.25 


1 


.42 


41142 + 


24 


7.4 




GlO.5+1610 


15 


52 


10, 


.5 


+20 


16 


10 


17.90 


1 


.40 


41187 + 


35 


7.2 




G14.4+1115 


15 


52 


14, 


.4 


+20 


11 


15 


20.16 


1 


.26 


41275 ± 


40 


3.5 




Gll.4+1509 


15 


52 


11, 


.4 


+20 


15 


09 


20.29 


1 


.30 


41503 ± 


96 


2.4 




G07.6+1439 


15 


52 


07, 


.6 


+20 


14 


39 


18.92 


1 


.37 


41582 + 


45 


5.9 




G16.9+1531 


15 


52 


16, 


.9 


+20 


15 


31 


18.89 


1 


.38 


41609 + 


48 


6.6 




GlO.7+1519 


15 


52 


10, 


.7 


+20 


15 


19 


19.11 


1 


.38 


41797 + 


97 


3.8 




G13.2+1326 


15 


52 


13, 


,2 


+20 


13 


26 


18.56 


1 


.45 


42041 ± 


48 


7.2 




G07.8+1503 


15 


52 


07, 


.8 


+20 


15 


03 


18.39 


1 


.03 


42045 ± 


74 




b 


G18.8+1345 


15 


52 


18, 


.8 


+20 


13 


45 


20.97 


1 


,11 


49262 ± 


54 


2.0 




Gll.4+1359 


15 


52 


11, 


,4 


+20 


13 


59 


20.37 


1 


.28 


68668 ± 


40 


4.5 




GlO.6+1139 


15 


52 


10, 


.6 


+20 


11 


39 


21.76 





.95 


93209 ± 


64 




b 


G12.8+1516 


15 


52 


12, 


.8 


+20 


15 


16 


21.65 





.92 


101640 + 


56 




b 


G07.4+1239 


15 


52 


07, 


.4 


+20 


12 


39 


22.40 





.75 


105743+ 101 




b 



5 




Fig. 3. — Spectra of member galaxies. The panels show, from left to right, spectra of galaxies G06. 8+1312, 
G07. 6+1439 and Gil. 4+1509 as examples of the data taken for this study. These spectra are the ones for 
which the largest, median and lowest cross-correlation coefficient was measured, respectively. The wavelength 
range used for the the cross-correlation (4800-7500A) is shown. In this figure, the spectra have been smoothed 
using a boxcar filter of size 13.6 A (5 pixels), for the sake of clarity. 
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''The names of the galaxies are based on their 2000 celestial coordinates (RA seconds and 
DEC minutes and seconds). Thus galaxy Gab.c+defg is located at 15 52 ab.c +20 de fg. 

^Redshift measured from emission lines. 

■^Redshift measured from absorption lines but it also has emission lines in the spectrum. 
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3. Results 

3.1. Galaxy velocity distribution 

Using the heliocentric radial velocities listed 
in Table 1, we define the putative members of 
RX J1552. 2+2013 as the 27 galaxies with veloc- 
ities between 38715 and 42045 km s^^. There are 
nine other confirmed members studied by Jones et 
al. (private communication) which were included 
in most of our analysis, but not in the galaxy ve- 
locity distribution and determination of dynamical 
mass. 

The data were analyzed with the statistical 

software rostat (Beers, Flynn & Gcbhartd 1990), 
which did not find any large gap in the velocity dis- 
tribution. In addition, no other data-points were 
foimd outside a ±3(J range. Fig. 4 shows the veloc- 
ity histogram for the 27 member galaxies studied 
by us. 

Using the robust bi-wcuglited c;stimator, ROS- 
TAT, the following values for the systemic red- 
shift and velocity dispersion were found: {z) = 
0.1357± 0.0011 and cr = 797± 185 km respec- 
tively. 

It is interesting to note, however, the effect of 
the exclusion of the emission-line galaxies when 
deriving these quantities, since those objects are 
believed to be recently accreted by the cluster, 
thus not yet virialized (e.g. Sodre et al. 1989; Bi- 
viano et al. 1997). Indeed, a simple inspection of 
Table 1 shows that 3 out of 4 emission- line galaxies 
occupy the edges of the velocity distribution. 

The exclusion of the emission-line galaxies re- 
duces the velocity dispersion of the group. As 
a consequence, the radial velocity for one other 
galaxy, G12. 2+1439 falls outside the new ±3cr 
range. If this galaxy is also excluded, the new sub- 
sample is then composed of 22 galaxies, for which 
the bi-weighted values arc (z) = 0.136 ± 0.001 and 
cr = 635 ± 164 km s"^. We consider this deter- 
mination of redshift and velocity dispersion the 
most reliable ones for RX J1552. 2+2013 (sec be- 
low). Note that for the determination of the lumi- 
nosity function all 36 galaxies in the sample were 
used (including the ones with emission lines). 

3.1.1. Dynamical mass 

We determine the dynamical mass of the clus- 
ter by using four different mass estimators, as sug- 



Av (103 s-i) 
-2-10 1 2 




0.13 0.14 



z 

Fig. 4.— Velocity histogram of RX J1552.2+2013. 
It shows the distribution of the radial velocities 
of 27 galaxies in the inner 625 h^Q"'^ kpc radius 
of RX J1552.2+2013, with redshifts within ±2500 
km/s of the systemic velocity of the group. The 
sticks on the upper part of the plot show velocities 
of individual objects. The rosat bi-weighted es- 
timator gives a velocity dispersion a = 797 km/s 
and a redshift of (z) = 0.1357 (dashed line), for 
the sample of 27 objects. The dashed part shows 
a sub-sample of 22 galaxies, obtained by exclud- 
ing four galaxies with emission lines and one other 
galaxy that becomes a ±3 cr-outlier with this ex- 
clusion. The bi-weighted estimator returned a = 
635 km/s and (z) = 0.136 (continuous line) for 
this smaller subsample. 

gested by Heisler et al. (1985): virial, projected, 
average and median mass estimators (see Table 2). 

The max;imum difference between different 
mass estimates is about 24%. According to Heisler 
et al. there is a 75% chance that the derived mass 
of any single system is within a factor of order 
2 of the correct value. However, caution notes 
have been given by several authors (e.g. Girardi & 
Mezzeti 2001) on the reliability of mass determi- 
nations when the galaxies are distributed over a 
small (central) part of the cluster and the number 
of redshifts is limited. The final, adopted mass for 
the cluster was obtained from the average value of 
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Table 2 
Mass Estimates 



(1) 


(2) (3) 


(4) 




(5) 




Non emission-line galaxies 


All 1 


galaxies 




Estimator 


Mass (1014 Ms) M/Lb (Mq/Lbq) 


Mass (10" Mq) 


M/Lb 


(Mq/Lbg) 



Virial 2.64 521 4.11 811 

Projected 2.73 539 4.10 809 

Average 2.20 433 3.29 649 

Median 2.71 534 3.74 738 

Mean value 2.57 507 3.81 752 



the results of the four different estimators. 

3.1.2. Location in the Lx-(7 relation 

The measured value of the bolometric X-ray lu- 
minosity of RX J1552. 2+2013 is 6.31 x 10^^ h^^ 
ergs~i (Jones et al. 2003) and there is no available 
measurement of T^ in the literature. This value 
of Lx is slightly above the value found for groups, 
Lx < 4 X 10^3 h^p2 ergs-i and a < 600 km s"! 
(Xue & Wu 2000), being more consistent with a 
low-mass cluster. 

According to the relations for groups and clus- 
ters from Mahdavi & Geller (2001), we find that 
for a system with this X-ray luminosity we would 
expect a velocity dispersion of about a = 534 km 
s~i, in good agreement with our direct measure- 
ment. In fact, even the value for the velocity dis- 
persion calculated including emission-line galaxies 
(797 km s~i) is within the dispersion of the points 
in their Fig. l-(b). 

The characterization of RX J1552. 2+2013 
cluster is also supported by the richness of this 
system. Within 625 h^Q kpc of the central galaxy 
there arc 19 galaxies between m3 (magnitude of 
the third brightest member) and m3 + 2. The 
Abell, Corwin & Olowin (1989) definition for a 
cluster is at least 30 galaxies within a radius of 
1.5 Mpc. Given the high density of observed mem- 
bers, this selection criterium would certainly have 
been fulfilled, had we surveyed a larger area. 



3.1.3. Mass-to-light ratio 

We estimated the luminosity of the central re- 
gions of the group by adding up the luminosi- 
ties of the 36 spectroscopically confirmed mem- 
bers, taking into account the completeness correc- 
tion derived from the spectroscopic sampling (see 
Fig. 5). The completeness correction was defined 
in the following way: N{m) = Ngrp{m)/C{m), 
where Ngrp is the number of galaxies spectro- 
scopically confirmed as members in a given mag- 
nitude bin. C{m) is the completeness, defined 
as: Nyf,i{m)/Ntot{m), the number of galaxies in 
a given magnitude bin for which we were able to 
get a reliable redshift, over the total number of 
galaxies in the same magnitude bin. We note that, 
for this analysis, we have negleted all the galax- 
ies redder than the red-cluster sequence, shown in 
Fig. 2. 

In order to compare with previous results, we 
have transformed our SLOAN g' and r' magni- 
tudes in standard Johnson-Morgan B magnitude 
using the transformations given in Fukugita et al. 
(1996). The total magnitudes have been corrected 
for Galactic-extinction (Schlegel, Finkbeiner & 
Davis 1998) as well as for the ^-correction (Fukugita, 
Shimasaku & Ichikawa 1995), under the assump- 
tion that all galaxies are early-type, which is valid 
for most of them. 

The total luminosity calculated within 625 kpc 
hyo^ is 5.06 X 10^1 Mqb- This leads to a mass-to- 
light ratio in units of Mq/Lbq of 507. Results 
for the several mass estimates and for the sam- 
ples with and without emission-line galaxies are 
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presented in Table 2. 



val, below the red-cluster sequence. 



3.2. The Luminosity Function 

We show in Fig. 5 the luminosity function 

of RX J1552. 2+2013 (solid circles) for galaxies 
with spectroscopically confirmed membership ei- 
ther obtained in this paper (27 galaxies) or given 
by Jones et al. (private communication, 9 galax- 
ies), corrected for incompleteness. The absolute 
magnitudes were calculated after correcting the 
observed magnitudes for Galactic extinction and 
applying /c-corrections. The selection function, 
also shown in Fig. 5, was calculated consider- 
ing only galaxies bluer than the upper limit of the 
adopted red cluster sequence. 

We have also estimated photometrically the lu- 
minosity function of RX J1552. 2+2013 down to ~ 
23 mag, in the three bands (the photometric sam- 
ple is complete at this magnitude) by adopting 
the following procedure. First, wc consider only 
galaxies bluer than the limit of the red sequence 
in the color-magnitude diagram shown in Fig. 2. 
Wc then binned the magnitudes of these galaxies 
in 1.0 magnitude bins and subtracted from each 
bin the average number of field galaxies with col- 
ors also below the red-sequence line, taken from 
two control fields. The two high-galactic latitude 
empty fields used as control fields were obtained 
with the same telescope, instrument and filters 
(Boris et al. 2005, in preparation). The counts 
derived from the two fields are in good agreement 
among themselves and with those of the Hawaii 
HDF-N field (Capak et al. 2004). The errors 
in each bin of the luminosity function were com- 
puted assuming Poissonian statistics for both field 
and group counts. These photometric luminosity 
functions are also shown in Fig. 5 as open trian- 
gles. They are strikingly similar to the spectro- 
scopic results (solid circles). Note, however, that 
the determination of the luminosity function using 
galaxy counts on and off the field is significantly 
more uncertain than the spectroscopic determina- 
tion given cosmic variance. 

The shape of the luminosity function is very 
similar in the three bands. However, it is some- 
what unexpected: the number of galaxies in the 
group flattens and then decreases for magnitudes 
fainter than g' ~ 20, r' ~ 19.5 and i' ~ 19. This 
can be clearly seen in the histogram shown in Fig. 
6, of the number of galaxies, per magnitude inter- 




Fig. 6. — Number coimts, per magnitude bin, be- 
low the red cluster sequence of RX J1552. 2+2013 
(i.e. below the continuous line in Fig. 2). Note 
that the number counts level off at the faint end 
indicating a flat or decreasing luminosity function 
for this system. 

The shapes of the luminosity functions shown 
in Fig. 5 are well described by Gaussian func- 
tions. In the i'-band this Gaussian is centered 
at Mi, = -20.0 ± 0.4 (m,/ = 19.37) and has 
a = 1.29 ± 0.3 mag. If we attempt a flt with 
a Schechter function, the best parameters are, in 



the i'-band, M* 



-21.3 ± 0.5 (m,/ = 18.05) and 



a = -0.59 + 0.24, in the range 16 < mj/ < 22. Re- 
sults for all bands and parameters for both Gaus- 
sian and Schechter luminosity functions are pre- 
sented in Table 3. Note that the results for the 
spectroscopic luminosity function do not change 
signiflcantly if we restrict the magnitude interval 
to exclude the faint magnitude bins which have 
one galaxy only (see results in middle pannel of 
Table 3). Lines indicating the best Schechter lu- 
minosity functions fitted first three lines of Table 
3) are plotted in Fig. 5. 

The results described above were checked in 
several ways. Here we exemplify the checks made, 
using the i'-band data, but equivalent results are 
obtained for the g'-band and r'-band data. The 
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Table 3 
Luminosity Function 



(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 






Schcchtcr Function 


Gaussian Function 






Band 


M* +51og(/i7o) 


a 


(A/) + 51og(/i7o) 


M 


Magnitude range 




g' 


-20.05 ± 0.45 


-0.42 ± 0.32 


-19.02 ± 0.32 


1.20 ± 0.19 


18.0 - 23.0 


Spectroscopic 


r' 


-21.07 ± 0.48 


-0.65 ± 0.26 


-19.59 ± 0.41 


1.31 ± 0.25 


17.0 - 23.0 






-21.34 ± 0.40 


-0.59 ± 0.29 


-19.99 ± 0.42 


1.29 ± 0.24 


16.0 - 22.0 




g 


-20.35 ± 0.58 


-0.74 ± 0.42 


-19.01 ± 0.50 


1.21 ± 0.27 


18.0 - 22.0 


Spectroscopic ^ 


r' 


-21.18 ± 0.57 


-0.77 ± 0.37 


-19.71 ± 0.44 


1.24 ± 0.27 


17.0 - 21.0 




i 


-21.38 ± 0.44 


-0.63 ± 0.35 


-20.10 ± 0.42 


1.23 ± 0.24 


16.0 - 21.0 




1 

g 


-20.21 ± 0.70 


-0.47 ±0.42 


-19.14 ± 0.32 


1.25 ± 0.22 


17.0 - 23.0 


Photometric 


r' 


-21.27 ± 0.62 


-0.64 ± 0.30 


-19.82 ± 0.36 


1.31 ± 0.27 


16.0 - 23.0 




i 


-21.59 ± 0.51 


-0.67 ± 0.27 


-20.03 ± 0.40 


1.39 ± 0.27 


15.0 - 23.0 



"^Note that these results have more limited magnitude range since bins with only one galaxy, at the faint end, were excluded 
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Fig. 5. — Luminosity Function of RX J1552. 2+2013. The panels show, from left to right, the luminosity 
functions in the g', r' and i' bands, respectively. The solid circles show the completeness-corrected number of 
spectroscopically confirmed members of RX J1552 per 1.0 magnitude bin in the GMOS field. The error bars 
are Icr Poissonian errors. The arrows show bins with number of galaxies less or equal to zero. The dotted 
line is the selection function of the spectroscopic sample. The continuous lines show the best fitted Schechter 
function of the spectroscopic sample (see values in Table 3). The brightest galaxy of the cluster was not 
included in the fit. The open triangles show the photometrically-determined luminosity function estimated 
through number counts and statistical subtraction of the background. The points have been shifted by 0.2 
mag, for the sake of clarity. The agreement between the spectroscopically and photometrically-determined 
luminosity functions is excellent. 



number of galaxies brighter than i' — 22 above the 
line in Fig. 2 which indicates the upper part of the 
red cluster sequence is 72 for RX J1552.2-f 2013 
and 64 ±7 for the mean of the two control (empty) 
fields, indicating good agreement. Note that, 
above this line, the number of objects in the 
RX J1552. 2-1-2013 i' image and in the empty fields 
should match (apart, of course, from statistical 
fluctuations and cosmic variance) given that these 
are expected to reflect the numbers of background 



objects. Moreover, if we plot a histogram of galaxy 
counts for objects below the cluster red sequence 
line (see Fig. 6), the histogram flattens for i' ^ 20. 
Since the field counts increase continuously with 
magnitude, the number counts of group members 
decreases. Consequently, we are confident that 
the drop in the luminosity function of the group 
RX J1552.2-h2013 is real. 

Fossil groups have, by definition, a lack of 
bright galaxies because of the selection function 
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used to catalogue them. The bright-end of the lu- 
minosity function of these systems is then known 
to be unusual, with too few L* galaxies. At 
the faint-end, nothing has been known, so far, 
about the shape of the luminosity function of these 
groups. For RX J1552. 2-1-2013 we just reach the 
magnitude of the dwarf upturn (the point where 
the curve goes from being giant-dominated to 
dwarf-dominated), which in the Virgo cluster is 
around m^ = 17, corresponding to Mji = -18.5. 
Therefore, the steep downward slope at the faint- 
end of the luminosity function shown in Fig. 5 is 
in part due to the lack of dwarf galaxies in the 
sample. Such a pronounced dip in the luminos- 
ity function has already been observed in several 
other systems' luminosity functions and in partic- 
ular in the composite luminosity function of com- 
pact groups studied by Hunsberger, Charlton & 
Zaritsky (2000). It is worth verifying whether this 
is a peculiarity of RX J1552. 2-1-2013 or, otherwise, 
a common feature of fossil groups. 

3.3. Surface photometry of the brightest 
cluster galaxy 

In the upper panel of Fig. 7, the azimutally av- 
eraged photometric profile of the central galaxy of 
RX J1552. 2-1-2013 is shown. The surface photom- 
etry was performed using the task ELLIPSE in 
STSDAS/IRAF, which fits eUipses to extended 
object isophotes. We allowed the ellipticity and 
position angle of the successive ellipses to change 
but the center remained fixed. The ellipse fitting 
was performed only in the deeper r' image. For the 
other bands, the software measured the isophotal 
levels using the parameters estimated in the r' im- 
age. There were a few small objects within the 
outer isophotes of the central galaxy which were 
masked during the profile fitting procedure. 

We have fitted a r-'^/^-law to the bright end of 
the galaxy profile, from well outside the seeing disk 
(3.0") to a radius corresponding to fir' — 23.0 
mag arcsec"^ (8.3"). In the lower panel of Fig. 
7, the residuals (data - r-^/^-law model) for the 
r'-band data are shown. The light excess over 
the de-Vaucoleurs profile, which is clearly detected 
in all three filters, is interpreted here as due to 
an envelope. The presence of this light enve- 
lope, in addition to the high luminosity of the 
galaxy, strongly suggests that the central object 
of RX J1552. 2+2013 is a cD galaxy. 




1.4 1.6 1,8 a 2.2 2.4 

Ri/* (arcsec'/i) 



Fig. 7. — Upper panel Photometric profile of the 
central galaxy. We show the isophotal levels be- 
tween a value of the semi- major axis of 2.5"and 
that where the counts reach la of the background 
level (26.8, 26.3 and 25.6 mag arcsec"^ for g', r' 
and i' bands respectively) as a function of semi- 
major axis to the power 1/4. The solid line is the 
best fit to the de Vaucoleurs profile between 3.0 
and 8.3"(/ir' = 23.0 mag arcsec"^). Lower panel 
residual between the actual r' band profile and the 
de Vaucoleurs profile fit to the bright end. 

This result disagrees with a similar analysis 
done by Jones et al. (2003) using a profile which 
reached similar isophotal levels. On the other 
hand, we agree with Jones et al. (2003) that the 
subtraction of the best-fitting elliptical model does 
not reveal multiple-nucleus, shells or tidal tails. 

4. Discussion 

We list in Table 4 all fossil groups studied to 
date. 

In Section 3.2 we showed that RX J1552. 2+2013 
has a luminosity function which has a dip at bright 
luminosities (by construction, since fossil groups 
were chosen to be environments with no bright 
elliptical galaxies besides the dominant elliptical) 
and, in addition, the luminosity function has a lack 
of faint galaxies around Mr = -18, just before the 
dwarf upturn, as seen in other systems such as for 
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Table 4 

Fossil group galaxies known to date 



(1) 


(2) 


(3) 




(4) 


(5) 


(6) 


Name 


RA (2000) 


DEC (2000) 




z 


^x.bal (10*^ hso -^) ergs s"! 


Reference 


NGC 1132 


02 52 51.8 


-01 16 29 


0. 


,0232 


1.9 


Yoshioka ot al. (2004) 


RX J0454. 8-1806 


04 54 52.2 


-18 06 56 


0, 


,0314 


1.9 


Yoshioka et al. (2004) 


ESQ 306- G 017 


05 40 06.7 


-40 50 11 


0, 


,035805 


129 


Sun et al. (2004) 


RX J1119.7-F2126 


11 19 43.7 


+21 26 50 


0, 


,061 


1.7 


Jones et al. (2003) 


RX J1159.8-F5531 


11 59 51.4 


+55 32 01 


0, 


,0810 


22 


Vikhlinin et al. (1999) 


CL 1205-1-44 


12 05 53.7 


+44 29 46 


0, 


,59 


180 


Ulmer et al. (2005) 


RX ,11256.0+2556 


12 56 03.4 


+25 56 48 


0, 


,232 


61. 


,Ioncs et al. (2003) 


RX ,71331.5+1108 


13 31 30.2 


+ 11 08 04 


0, 


,081 


5.9 


,Ionos ot al. (2003) 


RX ,11340.6+4018 


13 40 33.4 


+40 17 48 


0. 


1710 


25 


Vikhlinin ct al. (1999) 


RX J1416. 4+2315 


14 16 26.9 


+23 15 32 


0. 


137 


220. 


Jones ct al. (2003) 


RX J1552. 2+2013 


15 52 12.5 


+20 13 32 


0, 


,136 


63 


Jones et al. (2003) 


NGC 6034 


16 03 32.1 


+ 17 11 55 


0. 


,0339 


0.75 


Yoshioka et al. (2004) 


NGC 6482 


17 51 48.8 


+23 04 19 


0, 


,013129 


2.17 


Khosroshahi et al (2004) 


RX J21 14.3-6800 


21 14 20.4 


-68 00 56 


0, 


,1300 


20 


Vikhlinin et al. (1999) 


RX J2247.4+0337 


22 47 29.1 


+03 37 13 


0, 


,199 


41 


Vikhlinin et al. (1999) 



the Coma cluster. The faint end of the himinos- 
ity function of RX J1552. 2+2013 is significantly 
different from that of other galaxy clusters of sim- 
ilar mass. Indeed, for the 2dF and RASS-SDSS 
clusters, a ~ 1.3 in the blue-band (de Propris et 
al. 2003; Popesso et al. 2005), instead of values 
in the range -0.7 to -0.4 found here. In a search 
in the literature, we could find several examples 
of clusters which presented dips in their luminos- 
ity functions, but they are mostly associated with 
dense, dynamically well-evolved systems, such as 
X-Ray emitting cD clusters (e.g. Lopez-Cruz et al. 
1997; Valotto et al. 2004; Mobasher et al. 2003). 
On the other hand, a few loose groups, like Leo I, 
has also been reported to have a dip in its luminos- 
ity function at intermediate luminosities (between 
-19.5 < Mr <- 16; Flint et al. 2003), and the 
luminosity function of compact groups of galaxies 
also show a similar dip (Hunsberger et al. 1996), 
which suggests that there may be more than one 
mechanism in action, for the depletion of these 
galaxies in different environments. 

Fossil groups were suggested to be the end prod- 
ucts of merging of L* galaxies in low-density en- 
vironments (.Jones et al. 2003). The specific fossil 
group studied here, however, does not constitute 
a low-density environment and, in fact, is more 
similar to a galaxy cluster. The fairly high X-ray 
emission, the large fraction of elliptical galaxies 
(most of the bright galaxies in Fig. 1 are early- 
types), the radial velocity distribution (Fig. 4), as 
well as the lack of obvious substructures, suggest 



that RX J1552.2-h2013 is probably viriahzed. 

Under the merger scenario hypothesis, the 
mechanism usually claimed to explain the lack 
of L* galaxies is dynamical friction. It works by 
a deceleration of the orbital velocity of a galaxy, 
where the galaxy loses its kinetic energy to the 
pool of dark matter particles. This phenomenon 
causes the galaxy to spiral towards the mass center 
and eventually to merge with the central galaxy. 
The frictional deceleration is proportional to the 
mass of the galaxy, so this process is expected to 
be more efficient for the brightest cluster mem- 
bers. This process is probably more efficient dur- 
ing the cluster collapse- when radial orbits may 
prevail- than after virialization, when the galaxy 
orbits are more isotropic (e.g. Merritt 1985). Fos- 
sil groups/clusters appear to be an extreme case 
of this dynamical friction scenario, since all L* 
galaxies have merged and there was no further 
accretion of bright field galaxies into the system. 

Dynamical friction and subsequent merging are 
probably the processes responsible for the lack of 
bright galaxies in the luminosity function of fos- 
sil groups. However, it is interesting to note that 
these same physical processes cannot be efficient 
enough for low-mass galaxies in order to explain 
the shortage of low-luminosity galaxies (around 
Mr = -18 mag). 

An attractive explanation for the lack of faint 
galaxies in dense environments is the dimming or 
even total disruption of these objects caused by a 
succession of tidal encounters (Gnedin 2003). The 
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debris of the disruption of such galaxies is one of 
the possible sources of diffuse intra-cluster light 
and/or cD envelopes. Indeed, as shown in Section 
3.3, the central galaxy of RX J1552. 2+2013 has 
the light excess over its de Vaucouleurs profile that 
characterizes cD galaxies. 

What is puzzling about fossil systems and 
RX J1552.2+2013 in particular is the high effi- 
ciency with which both mechanisms have acted. 
The general case for clusters is to not have dips in 
the luminosity functions (de Propris et al. 2003; 
Popesso et al. 2005). The exceptions are the cen- 
tral regions of rich clusters. For instance, the dip 
in the luminosity function of the Coma cluster 
core is at R~ 17.0 and B~ 18.0 (Trentham 1998), 
which is close to the faintest limit of the luminosity 
functions presented here. 

On the other hand, the disruption of faint 
galaxies is not instantaneous, requiring a few 
crossing times before tidal heating can strip off less 
bound stars or even tear the galaxies apart. There- 
fore, the faint galaxies should be bound to these 
structures since pre-virialization times. Moreover, 
the existence of a very compact and rich core in 
this system should increase greatly the number of 
collisions, enhancing the tidal stripping efficiency. 

If this scenario is correct, we should not ex- 
pect the same lack of faint galaxies in less rich 
fossil groups, where the galaxy density and thus 
the tidal encounters were much less frequent at 
early times. More observations are needed to test 
this scenario. 

One detail that should be kept in mind is 
that we have observed just the inner part of 
RX J1552.2-h2013 (- l/3i?„r), region where a 
few previous studies have found a lower dwarf-to- 
giant ratio than that measured in the outskirts of 
the systems (e.g. Phillipps et al. 1998). Popesso et 
al. (2005), however, using a very large sample of 
130 SDSS clusters with X-ray counterparts, have 
found only a weak dependence of the dwarf-to- 
giant ratio with cluster-centric distance. The fun- 
damental parameter, in this case, seems to be the 
local density (Driver, Couch & Phillipps 1998), in- 
stead of the cluster-centric distance. And, if we 
are to draw any conclusions based on the present 
knowledge of fossil systems and the data we gath- 
ered, is that fossil systems had a very dense origin. 

Considering the merging scenario, it is possi- 



ble that the overluminous galaxy has been formed 
within a substructure inside the already consol- 
idated larger structure. In that case, one could 
think of a scenario where a compact group was 
formed within a larger rich group, which would 
then have quickly merged and would have left be- 
hind the brightest elliptical galaxy of what today 
is seen as a fossil group. One weak argument 
against this scenario is that compact groups are 
not usually found within such massive structures, 
but instead are more often surrounded by loose 
groups. This may, however, be a selection effect in 
the compact group catalogues available in the lit- 
erature, which use an isolation criterion for group 
selection and may, therefore, select against com- 
pact groups embedded in clusters. 

Another important point is that member galax- 
ies in compact groups are emerging as very old 
systems (Proctor et al. 2004; Mendes de Oliveira 
et al. 2005). This suggests two possible scenar- 
ios for compact groups: they are either long-lived 
systems, which have not had a major merger over 
a significant fraction of a Hubble time (scenario 
also supported by Zabludoff & Mulchaey 1998) or 
they are systems which merge so fast that they 
are not caught at intermediate stages of evolution. 
The existence of a large population of fossil groups 
would support the latter scenario of fast merging 
for compact groups, at least for those within clus- 
ters or rich groups. 

One problem for the merging origin of fossil 
groups is their apparent much higher mass-to-light 
ratios as compared to compact groups and poor 
clusters. As explained earlier, recent work of Yosh- 
ioka ct al. (2004) derive very high values for the 
M/L of fossil groups and conclude that at least 
some fossil groups are not end products of com- 
pact group evolution. They suggest that alter- 
natively these objects are the massive tail of the 
elliptical galaxy distribution, formed at high red- 
shift (fossil-elliptical origin). In the present case, 
the system is definitely a cluster and not a single 
elliptical galaxy. 

The whole scenario of fossil group formation 
may become more clear when more of these groups 
are studied spectroscopically. Ongoing determina- 
tions of the luminosity function for a large sample 
of fossil groups and the detailed study of the prop- 
erties of the brightest group members, including 
the determination of their ages and metal abun- 
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dances, may also elucidate some of these ques- 
tions. In addition, simulations such as those pre- 
sented recently by D'onghia et al. 2005 (astro- 
ph/0505544), but at higher resolution, will allow a 
direct comparison of the observed luminosity func- 
tion of a fossil group and the expected luminosity 
function of merged groups. 
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